Skip to content

[SPARK-52194] Add spark-connect-server.yaml example #206

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
dongjoon-hyun wants to merge 1 commit into from
Closed

[SPARK-52194] Add spark-connect-server.yaml example #206

dongjoon-hyun wants to merge 1 commit into from

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented May 16, 2025 •
edited
Loading

What changes were proposed in this pull request?

This PR aims to add spark-connect-server.yaml example.

Why are the changes needed?

To provide an example to launch Spark Connect Standalone Server.

Does this PR introduce any user-facing change?

No. This is a new example.

How was this patch tested?

Manual test.

$ helm install spark spark/spark-kubernetes-operator
$ kubectl apply -f examples/spark-connect-server.yaml
$ kubectl get sparkapp
NAME                   CURRENT STATE    AGE
spark-connect-server   RunningHealthy   3m1s

$ kubectl logs spark-connect-server-0-driver | tail -n1
{"ts":"2025-05-16T20:42:03.114Z","level":"INFO","msg":"Spark Connect server started at: 0:0:0:0:0:0:0:0%0:15002","context":{"host":"0:0:0:0:0:0:0:0%0","port":"15002"},"logger":"SparkConnectServer"}

After port-forwarding 4040, visit the pod's driver website Connect tab.

Screenshot 2025-05-16 at 13 46 09

Was this patch authored or co-authored using generative AI tooling?

No.

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented May 16, 2025

Could you review this PR too, please, @peter-toth ?

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented May 16, 2025

Thank you so much, @peter-toth . 😄 Merged to main.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-52194 branch May 16, 2025 21:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@peter-toth peter-toth peter-toth approved these changes

Assignees

No one assigned

Labels

EXAMPLES

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@dongjoon-hyun @peter-toth